Papers with high-level classification tasks
A Multi-layered Approach to Physical Commonsense Understanding: Creation and Evaluation of an Italian Dataset (2024.lrec-main)
Copied to clipboard
| Challenge: | Using a multilingual model, we examine the ability of large language models to perform reasoning tasks. |
| Approach: | They propose to use a multilingual model to analyze commonsense reasoning in large language models for Italian and to provide a semi-automated system to complete the annotation. |
| Outcome: | The proposed model performs at high-level classification tasks but its easoning is inconsistent and unverifiable, since it does not capture intermediate evidence. |